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Abstract 

We analyze and identify stationary fields with linear regressions and quadratic conditional vari- 
ances. We give sufficient conditions to determine one dimensional distributions uniquely as normal, 
and as certain compactly-supported distributions. Our technique relies on orthogonal polynomials, 
which under our assumptions turn out to be a version of the so called continuous q-Hermite polyno- 
mials. 



1 Introduction 

The literature suggests that the distribution of a random sequence is often determined uniquely by the 
first two conditional moments. A classical result of P. Levy has been augmented by a number of results 
that replace assumptions on trajectories by more conditionings. Building on the work of Plucihska 
p^ , Wesolowski [|l6j determined all stochastic processes with quadratic conditional variances under the 
assumptions that lead to processes with independent increments. Szablowski jl^ , jist shows that first two 
conditional moments determine the marginal distribution in smooth cases. In [Q we show that the first 
two conditional moments characterize gaussian sequences. For more references and additional motivation 
the reader is referred to Chapter 8]. 

In this paper we analyze stationary sequences under the assumptions which are invariant with respect 
to the ordering of the index set. Let (Xfc)fcez be a square-integrable random field. We are interested in 
the fields with the first two conditional moments given by 

E{Xk\ . . . , Xk-2,Xk-i,Xk+i,Xk+2, ■ ■ ■) = L{Xk-i, Xk+i) (1) 



E{Xl\ . . . , Xk-2, Xk-i, Xk+i, Xk+2, ■ ■ ■) — Q{Xk-i, Xk+i) (2) 
for all fc e Z , where L{x, y) — a{x + y) + b is a symmetric linear polynomial, and 

g(x, y) = A{x^ + ?/) + Bxy + C + D{x + y) (3) 

is a symmetric quadratic polynomial. 
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It turns out that conditions (H) together with some technical assumptions imply that the eigen- 
functions of the shifted conditional expectation are certain g-orthogonal polynomials, see (^o|). We explore 
this connection to identify the one-dimensional distributions of (Xk) when the coefficients of the quadratic 
form depend on one real parameter R in addition to the correlation coefficient p. 

We show that the following change occurs as the values of the parameter change. 

• For a range of values between the two "critical values" of the parameter random field (^fc) is 
bounded, its one-dimensional distribution is uniquely determined, and has a density. 

• At the upper "critical value" of the parameter R the distribution C(Xq) is normal. 

• At the lower "critical value" of the parameter R the distribution C{Xo) is two-valued. 

The paper is organized as follows. Section]^ lists the assumptions used throughout the paper. Section 
H contains the statements of the main results. The next four sections contain lemmas and proofs. In 
section ^ we construct stationary Markov processes which satisfy (|l]) and (|^) . Section ^ collects concluding 
remarks. 

2 Assumptions 

The following general assumptions will be in place throughout the paper. 

• We assume that {X^) is L2-stationary and that all one dimensional distributions are equal, 

Xk^Xo for aU fc e Z (4) 

• Since (Q) and (||) are not affected by non-degenerate linear transformations of Xk, without loss of 
generality we assume E{Xk) = and E{X'^) = 1. All specific assumptions about the coefficients of 
Q{x,y) refer to this case. 

• We put the following restrictions on the values of the first two correlation coefficients p = corr{X(), Xi) 
and r2 ~ corr(A'o, A'2). 

p ^ (5) 

ra + 1 - 2|p| > (6) 

Remark 2.1 Note that ^ excludes i. i. d. sequences, and ^ implies \p\ < 1 thus excluding sequences 
formed by repeating a single random variable. Clearly, both i. i. d. sequences and constant sequences with 
second moments satisfy and but can have arbitrary distribution. R is somewhat surprising that 
for other values of p the distribution of Xq is determined uniquely. 

3 Theorems 

Under mild assumptions condition determines the covariances of (A^/t) up to a multiplicative factor. 

Theorem 3.1 Let (Xk) be an L2-stationary random field such that ^) holds true for all k, and conditions 
and (j^ are satisfied. Let rk — corr{Xo, Xk) denote the correlation coefficients. 
Then 

(i) rk = pl'^l for all k e Z. 
(ii) One-sided regressions are also linear, 

E{Xk\...,X^i,Xo)=rkXo,k = l,2... (7) 
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By symmetry, Theorem B.l implies the foUowing 



Corollary 3.1 Under the assumptions of Theorem 3.1, E{X}^\Xq) = p'^^'^o for all k 



We will be interested in how the properties of one dimensional distribution £(Xo) change with the 
values of the coefficients of the quadratic form Q. 

Proposition 3.1 Let {Xf.) be an L 2- stationary standardized random field with conditional moments given 
by ^ and and such that conditions are satisfied. Suppose that holds with A < 1/(1 + p^). 

If A{p'^ + -ir) + B < 1 then Xq is bounded. If A{p'^ + + B = 1 and D =/= then either Xq is bounded 
from below (D > 0) or from above (D <0). 



Proposition 3.1 suggests that the case when 

A{p' + \) + B = l (8) 
p^ 

and Z) = is of interest. This case includes the Gaussian fields, where A — p^/(l + p^)^ and B = 
2p^/(l + p^)^; in fact, we show in ^ that for a Markov chain which satisfies (|]) and (^, the coefficients 
of ^ either satisfy constraint (||), or 2 A + Bp^ = 1, and that D ~ 0. Since by taking the expected value 
of (H) we get a trivial relation 

C ^1-2A~ Bp^ (9) 



(here we used r2 — p^ by Theorem ^.l[ ) this leaves just one free parameter besides p on the right hand 
side of (H). As this free parameter we will use a scaled version of B defined by 

R = B{p+-f (10) 
P 

Theorem 3.2 Let {Xk) be an L2-stationary standardized random field with conditional moments given 
by ^ and and such that conditions (0-|^ are satisfied. Furthermore, assume that the coefficients on 
the right hand side of are such that D — and holds true. Then the following three statements 
hold. 

(i) For < R < 2 the one- dimensional distribution C{Xo) has the uniquely determined symmetric 
distribution supported on a finite interval. When R — 0. Xq = ±c has two values. 

(ii) For R — 2 the one- dimensional distribution C{Xq) is normal. 

(Hi) For R > 2 the one- dimensional distributions C{Xq) are not determined by moments. 

The infinite number of variables in the conditional expectations in (|l|) and ^ cannot be easily reduced. 

Theorem 3.3 For every value of — 1 < p < 1 there is a non-degenerate L2-stationary random field which 
satisfies condition (Qj, has linear regressions 

E{Xk\Xk-i,Xk+i)=a{Xk-i+Xk+i), (11) 

has quadratic second moments 

E{Xl\Xk-i,Xk+i) = a2(Xfe_i + Xk+if + C, (12) 

and 



(i) the conclusion of Theorem 3J_(i) fails 



(ii) the conclusion of Theorem 3.i fails 



In Section^, for every value of parameters < i? < 2 and < jpl < 1 we construct strictly stationary 
Markov chains which satisfy the assumptions of Theorem 
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4 Proof of Theorem |37T] 



We use the notation E{- \ . . . , X„) to denote the conditional expectation with respect to the sigma field 
generated by {Xk : k < n}. Occasionally, we will also write E-^{X) :— E{X\T). 

Let Tfc = E{XoXk) be the correlation coefRcients, k — 0, 1, . . ., and recall that p = ri 7^ by 
assumption. 



Theorem 3.1 follows from the following two observations. 
Lemma 4.1 Under the assumptions of Theorem \3. j| 
(i) fk as A; — > 00. 
(a) rl <1 for all k > 2. 

Proof. Multiplying by Xq and taking the expected value of both sides we get = a{rk_i + Vf^^i). 
Since p ^ 0, (|^) implies that 1 + r2 > 0. Therefore a = p/{l + r2) and the correlation coefficients 
satisfy the recurrence 

(1 + r2)rk = p{rk-i + rk+i), k = 1,2,... 

For fixed p,r2, this is a linear recurrence for {rk)k>2- Inequality (|6|) implies that the characteristic 
equation of the recurrence has two distinct real roots and their product is 1 . There is therefore only one 
root, c, in the interval (—1, 1) and rt = hc^ . This shows that = r2C^^'^,k = 2,3, . . .. In particular, 
Tfe 0, and r| < 1 for k> 2. 

□ 



Lemma 4.2 If (Xk) satisfies the assumptions of Theorem \3. f[ , then 

E{X^a+i\ ■ ■ ■ , X„) = pXn (13) 
Proof. We first show that for all n e Z, fc > 2 there are coefficients a{k) 7^ and b{k) E M such that 

E{Xn+l\ . . .,Xn-l,Xn,Xn+k,Xn+k+l, • • •) = a(k)Xn + b{k)Xn+k (14) 

and 

E{Xn+k-l\ ■ ■ ■ , Xn^l, Xn, Xn+k, Xn+k+1, ■ ■ ■) = b{k)Xn + a(k)Xn+k- (15) 

We prove this by induction with respect to A: > 2. 

For k = 2, this follows from (0) with a(2) = 7^ 0, see (|). 

For a given k > 2, suppose that a{k) ^ and both ( |l^ and ( [l5| ) hold true for all n E "L. We will 
prove that the same statement holds true for fc + 1. 

Conditioning on additional variable Xn+k and using the induction assumption we get 

E{Xn+l\ . ■ . , X„_i, X„, Xnj^k+lt Xn+k+2, ■ ■ ■) = 
^...,X„_i,X„,X„+fc + i,... ^^...X„-i,X,,.X„+k.X„ + k+l.---^Xn+i)) 
a{k)Xn + b{k)E{Xn+k\ Xn-l,X„,Xn+k+l, ■ ■ ■) 

Now adding Xn+i to the condition in E{Xn+k\ ■ ■ ■ , X„-i, Xn, Xn+k+i^ ■ ■ ■) and using the induction as- 
sumption we get 

E{Xnj^k\ ■ ■ ■ , Xn^i, Xn, Xn+k+l, Xn+k+2, ■ ■ ■) = 

J^...,Xn-l,Xn,X„^k + l,X„^k + 2,--- ^ ^■■■.-f n,X»i + l,^7i + fc + l,^7i + fc + 2.--- ^J^^^^I^^'J^ _ 

b{k)E{Xn+l\ ■ ■ . , Xn-l,Xn, Xn+k+1, Xn+k+2, ■ • •) + 0,{k)Xn+k+l 

Combining these two expressions we get the linear equation 



M = a{k)Xn + b^{k)M + a{k)b{k)X, 



n+k+l 
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for unknown random variable AI = E{Xn+i\ . . . , Xn-i, Xn, Xn+k+i, Xn+k+2, ■ ■ ■)■ Notice that since 
a{k) 7^ 0, if 6^(fc) — 1 then Xn, Xn+k+i are hnearly related. Therefore, r^^-^ = 1, contradicting Lemma 

4.1 (ii). (Case k = 2 requires separate verification: b'^{2) — (^i^^^yi < 1 by (^)). Thus fe^(fc) 7^ 1 and M is 



determined uniquely as the linear function of X„, Xn+k+i- This proves (|l4|). By symmetry (or by similar 
reasoning) (|l5|) holds true. The equation gives a{k + 1) = i-i^k) which shows that a{k + 1) ^ 0. This 
completes the induction proof of ( p^ ) . 

Since |rfc| < 1 for k > 2, the coefficients a{k),b{k) in a linear regression are determined uniquely. A 



calculation gives b{k) = ^^^i^'' Using Lemma 4.1(i) we have h{k) ^ as fc ^ 00. Passing to the limit 
as A; ^ 00 in ( |l^ ) we get (|l3|). q 



Proof of Theorem 3^. Applying /c-times formula (^^, we get E{Xk\ ■ ■ ■ , ATq) = p Xq. This implies 
E{X^Xk) = / . □ 



5 Proof of Proposition 

A simple calculation using ^ and (|l0| ) gives the following. 
Lemma 5.1 The following two conditions are equivalent: 
(i) A<l/{l + p^); 
(ii) i? > 1 - 

The second part of the next lemma will serve as the first step in the induction proof of Lemma ^.5| . 
Lemma 5.2 If (Xk) satisfies the assumptions of Theorem \3. j| and ^ holds true, then 

(1 ~ Ail + p^))E{Xf\ . . . , Xo) = (A(l - p2) + Bp^)X^ + C + D{1 + p^)Xo. (16) 
// in addition holds true and R> then 

EiXf\Xo)=p^X^ + l-p^+-fXo, (17) 

where 7 ^ . 



Proof. Since ^;(A:iA:2|...,A:o) ^ E-'^'> {XiE-'^^{X2)), from Lemma ^ we get 

E{XiX2\...,Xq)^ pE{Xf\...,Xo). (18) 

We now give another expression for the left hand side of (p^). Theorem i mplies that L{x,y) ~ 
jf^ix+y). Since E{XiX2\. . . ,Xo) - E{X2E{Xi\ . . . , Xo, X2, . . .)\. . . , Xo) fronTf]) we get E{XiX2\. ..,Xo) 



p 



r£;(X2(X2+Xo)|...,Xo). By LemmaOthis implies i;(XiX2|...,Xo) = ^X^+j^E{Xi\...,Xo). 



Since p ^ 0, combining the latter with ( [l8| ) we have 

i?(X||. . . ,Xo) = (1 + p')i?(x2|. ..,Xo)~ p'xl (19) 
We now substitute expression (19) into (||) as follows. Taking the conditional expectation E{- \ . . . ,Xo) 



of both sides of (|^) with fc = 1 we get 

E{X^\. ..,Xo) = AXl + AE{Xl\. . . , Xo) + BXlp"" + C + D{1 + p')Xo 
Replacing i?(Ar||. . . , Xq) in the above expression by the right hand side of (|l^) we get ( |l6|) 



If (g|) holds true then identity (|lj) follows by a simple calculation, since by Lemma 5.1 and the as- 
sumption i? > we have A < 1/(1 + p^). q 

By symmetry, we can switch the roles of Xo,Xi in (p7|). Therefore the assumptions of Corollary 
3] are satisfied. This implies integrability, see also ||l^, Theorem 2] for another proof. 



Corollary 5.1 Under the assumptions of Theorem 3.1 E{\Xk\^) < 00 for all p > 1. 
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5.1 Proof of Proposition IsTl 



By Theorem 3.1(ii) and ( 



To prove the first part, notice that if Xq is unbounded then < . The latter implies 

that A(p2 + l/p2) + 5 > 1, Indeed, write A{p^ + 1/ p') + B = 1 + A. Then ^jL^ffptf/ ^ + i_(f+p.)^ , 
so A > 0. 

Furthermore, if (^) holds true then an elementary calculation gives ^j^'^^^H^^ = p^. Thus condition 
D > implies that Xq must be bounded from below. Similarly, if D < then Xq must be bounded from 
above. 

6 Proof of Theorem |3.^ 

6.1 Orthogonal polynomials 

Define polynomials Qn by the recurrence 

xQn{x) = Qn+i{^) + {l + q+--- + q''-^)Qn~i{x) (20) 

with Q^i{x) = 0,Qo{x) = 1. (Then Qi{x) — x and Q2{x) = x'^ — 1). Clearly, Qn are the Hermite 
polynomials when q = 1. 

Polynomials Qn after a change of variable transform into the continuous q-Hermite polynomials, see 
1^ and |lo[] . Thus we can deduce information about the measure that makes Qn orthogonal; this measure 
is unique (with explicit representation for the density) and has bounded support when — 1 < g < 1, 
normal when q = 1, and is non- unique when q > 1. Later on we shall see that Qn are orthogonal with 
respect to the distributions of £(Xo). 

The next lemma collects these results together. A sketch of the proof is enclosed for completeness. 



Lemma 6.1 Let Qn be defined by 

(i) If q < —1 then there is no probability measure with respect to which Qn are orthogonal. 

(a) If —1 < 9 < 1 then Qn are orthogonal with respect to a unique probability measure. This measure 
is symmetric on M and has bounded support. 

(Hi) If q = 1 then Qn are orthogonal with respect to a unique probability measure which is normal. 

(iv) If q > 1 then Qn are orthogonal with respect to an infinite number of probability measures. 

Proof, (i) Follows from the fact that the coefficients in (pO|) must be non-negative. 



(ii) This is an immediate consequence of Carleman's criterion, see 13, page 59]. 

It is easy to see that q — — I corresponds to the (unique) symmetric two-point distribution Xq = ±1. 
This is a degenerate case, often excluded from the general theory of orthogonal polynomials because 
QniXo) = for all n > 1. 

(iii) This is the consequence of the classical result that normal distribution is determined uniquely by 
its moments. 

(iv) This follows from Berezanskii's result as reported in addendum 5 (page 26) of Q]. Notice that 
the latter deals with normalized rather than monic polynomials, see ( |30|) below. Since E{Q'^{Xo)) — 

rifc^i ; Berezanskii's theorem is used with 6„ = \J ''"q^i ^ ^-nd the condition bn+ibn-i < bl holds 
true because x i-^ log(g'^ — 1) is concave when q > 1. 

Several explicit weight functions for (/-Hermite polynomials with q > 1 are given in . |— | 

The following lemma shows that we can find orthogonal polynomials by finding the eigenfunctions of 
conditional expectations, and is based on well known motives. 
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Lemma 6.2 Let f,g be two functions such that f{Xi) and g{Xi) are square-integrable. If C{Xo) — 
C{Xi) and a ^ P are real numbers such that E{f{Xi)\Xo) ~ af{X()) and E(g{Xo)\Xi) — f3g(Xi) then 
E{f{Xo)giXo)) = 0. 

Proof. This follows from E{f{Xi)g{Xo)) = aE{f{Xo)g{Xo)) = (3E{f(Xi)g{X,)). □ 



6.2 Proof of Theorem |3T2 

Let 



(21) 



It is easy to see that the range < i? < 2 corresponds to — 1 < g < 1 and that R = 2 when q — 1, 
and R = when q = — 1 . 

Lemma 6.3 If q is defined by then polynomials Qn{x) defined by ^dj) satisfy 

^^«Qn(Xl)=p"Qn(^0). (22) 

Proof. The proof is by mathematical induc tion with respect to n. The result is trivially true for n — — I 
(with (5_i — 0) and for n — 0. By Theorem 3T, ( |2^ ) holds true for n = 1. Since we assume that D = 0, 
formula (|r^ implies that (|2^) holds true for n = 2. 

Suppose ( |2^ ) holds true for n,n — 1, n — 2, and n — 3. We will show that ( p2|) holds for n + 1. 

The proof repeatedly uses conditional expectations £{■) = i<;---.^-i.^o (.^^ 

Consider £(XiQn{X2)). We will first obtain two equations (|2^), ( p^ which allow us to determine 
conditional moments (5,1(^2)) and £{XiQn{Xi)). 

The first equation is obtained as follows. By induction assumption, £{XiQn{X2)) — £{XiE---''^"''^^Qn{X2)) 
p"£{XiQn{Xi)). On the other hand, equation gives 

£iXMX2)) = —^{£{XoQ„iX2))+£iX2QniX2))). 

Therefore 

£iX2Qn{X2)) = (1 + p2)p"-i£(XiQ„(Xi)) - p^''XoQniXo). (23) 

To obtain the second equation, consider f(Xj^(3„_i(X2))- By induction assumption, £{XfQn-i{X2)) — 
p''-'^£{XfQ„-i{Xi)). On the other hand, equations (|) and (|) with D = give 

f(^?g„-i(^2)) = 
yl£(X|g„_i(X2)) + A£(x2g„-i(X2))+ 

Bf(XoX2g„-l(X2)) + C£(Q„_i(X2)). 

(We will use relations (^ and (||) later on.) 

Thus, using the induction assumption, we obtain the second equation 

p"-i£(X2Q„_i(Xi)) = (24) 

A£(X|Q„_i(X2)) + V""'^oQn-l(^o) + 
BXo£{X2Qn-l{X2)) + Cp2"-2Q„_^(Xo). 

Polynomials (3„ satisfy second order recurrence of the form xQn(x) — Qn+i{x) + /3„+i(5n-i(a;). We 
use it to rewrite (24) as follows. 

(XiQ„(Xi)) + p"-i/3„f (XiQ„_2(^i)) = (25) 

A£{X2Qn{X2)) + Al3n£{X2Qn-2{X2)) + V""'^oOn(^o) + V""'/3n^og„-2(Xo) + 

BX„£{Qn{X2)) + BXo(3n£{Qn-2{X2)) + Cp^''-^Q„-i{Xo). 



7 



Now use (|23| ) to eliminate £{X2QniX2)) from this equation. Since C = 1 — 2A — p B this gives 

(l-yl(l + p2))£(XiQ„(Xi)) - (26) 
/3„(A(1 + p2)p-2 _ l)f(Xig„_2(^i))+ 
/3„p"-3(A(p2 _ 1) + B)XoQ„_2(^o) + 

- p') + sp2)Xog„(Xo)+ 

(l-2A-p2B)p"-lQ„_^(Xo). 

By (^), identity pi'lf_\'^l^p-iys^ = —p^q (recall that q is given by (^l|)) and elementary calculation we 
now get 

£(XiQ„(Xi)) = (27) 
(p"-3XoQ„-2(^o) - f (XiQ„_2(^i))) + 
p"+i^oQ„(^o) + (1 - p2)p"-iQ„_i(Xo) 

Since a;(3„(a:;) = Qn+i{x) + Pn+iQn-i{x), and by induction assumption E{Qn-'i{Xi)) = p"^^(5„_3(Xo), 
this implies 

£(Q„+i(Xi)) = p"+iO„+i(Xo)+ 

(1 - (^^^ _ p^^^ ^ 1) Q„-l(Xo). 

Since ( pO| ) means that /3n+i = 9/3n + 1, this ends the proof, q 
Proof of Theorem |3.2|. All assumptions are symmetric with respect to time-reversal. Therefore, 



formula (g2|) imphes E{Qn{Xo)\Xi) = p"Q„(Xi). Since < |p| < 1, Lemma p.2\ (used with / — Qm,g = 
Qn,n m) proves that Qn are orthogonal with respect to C{Xq). Therefore, Lemma |6.l| identifies 
uniquely the distribution C{Xo) for both R — 2 and R < 2 cases. 

The distribution is not determined uniquely by the moments when q > 1 which corresponds to i? > 2. 

Finally, when the distribution is determined uniquely, the odd-order moments EX^"'^^ = by (|20|). 
Therefore the distribution of Xq is symmetric. 

□ 



7 Proof of Theorem |37^ 

We begin with the following simple lemma. 

Lemma 7.1 Let Xq, Yq be integrable random variables. Suppose that J-, Q are a-fields such that a{Xa, J-) 
and a{YQ,Q) are independent, and there is p such that E{Xo\J-) = pXi, E(Yo\Q) = pYi, E{X'^\J-) = 
p'Xl + l-p' , and E{Yi\g) = p'Y^ + l-p'. 

Let Zfc = {aXk + bY^), where + 6^ = 1 and denote by J- W Q the a -field generated by J- U Q . Then 

E{Zo\Tvg) = pZi, (28) 

EiZ^\J^vg) = p^Zf + 1- p''. (29) 

Proof. Clearly E{Zo\T V ^) = aE{Xo\T V 5) + bE(Yo\T V G) proving (H). Similarly, E{Z^\T V ^) = 
'^E{Xi\T\/g)+b'^E(Y^\T\/g)+2abEiYoXQ\T\/g). Now EiYaXo\T\/g) = E{YoE{Xo\T\/g ,Yo)\Tvg) = 



pE{YoXi\J^ V g). Since Xi is J" V ^-measurable, we get EiYoXolJ" V g) = p^XiYi, which proves (|29|). 
□ 
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7.1 Proof of Theorem 



3.3 



Fix — 1 < p < 1. First define a periodic stationary sequence {^k) such that S,k+2 = Cfc S'^d with the 
correlation coefficient p. To this end define the joint distribution of ^1,^2 by 

Pr(a = 1,6 = 1) = Pr(ei = -1,6 = -1) = ^ 



4 ' 
1-p 



Let (7fe) be a centered Markov gaussian sequence with correlations E{-fQjk) — r'', where r = ^ p 



p 



Pr(6 - -1,6 = 1) = Pr(6 = 1,6 = -1) 

d 

and independent of (6)- 

Let Xk = a6 + bjk, where + b"^ — 1. Then E{XqXi) — a^p + b^r. By selecting a close enough to 
1, and by varying p we can thus have correlations corr{XQ, Xi)fill out the entire interval (—1,1). 

Using Lemma 7_A we verify that {Xk) satisfies (|ll|) and (|lj) with a = p/2,C = 1 — p^. Indeed, 
^(616, 6) = p6 = P(6 + 6)/2 and S(6'I6, 6) = l = p'(6 + 6)V4 + l - Similarly, the gaussian 
sequence satisfies £^(7i|7o,72) = 1^(70 + 72) = /o(7o + 72)/2 and i;(7^|7o,72) = (70 + 72)^/4 + 1 - 

When a ^ the correlation coefficients E{XoXk) do not converge to 0. Thus the conclusion of 



Theorem 3.1 (ii) fails. 

Notice that Q — + const which corresponds to the normal case (i? = 0); the distribution of Xq is 



not compactly-supported but for a it is not normal. Thus the conclusion of Theorem 3.2 fails 



8 Construction of Markovian fields 

In this section we construct Markov fields which satisfy (|^) and (||), proving the following. 

Proposition 8.1 For all < p^ < 1,0 < R < 2, there are stationary Markov chains that satisfy the 
assumptions of Theorem 3.L 

Since R = corresponds to the elementary two- valued Markov chain which was explicitly analyzed in 
1^, and R — 2 corresponds to stationary Gaussian Markov processes, we only consider the case < i? < 2. 
Through the remainder of this section we fix p, R. Let Qn be given by the recurrence 

xQn{x) = bn+lQn+lix) + b^Qn-lix) (30) 

with initial polynomials Qo{x) ~ l,Qi{x) = x, where 6„ = ■\/l + g + . . . + g"^-'-, ba = 0, 61 = 1, and q is 
given by (|2|) . Since q > — 1 , 5„ > for all n > 1 . These are the normalized orthogonal polynomials from 
the proof of Theorem 3.2. 

Let ^ be a probability measure which makes Q„ orthogonal. 

Lemma 8.1 If —1 < q < 1 and \p\ < 1, then "YlH^^a P^Qn{y)Qn{x) converges in L2{fJ-{dx)fi{dy)) to a 
non-negative function. 

Proof. The case g = 1 is classical and the sum of the series is ^ exp(— p^^^2L+^_i^^H££), 

For — 1 < g < 1 an explicit product representation for the series can be deduced from the facts collected 
in 1^, see also H, (3.9)]. Namely, in the notation of Q,i(.t) ~ '^(j_q^"2^^ — ^ where x = 2cos{9) / ^1 — q. 
Therefore, using H (3.9)] with x = 2cos{e^)/y/T~^, y = 2 cos{9y)/ ^/T^ (see also [|[ (2.10), (5.2), and 
(5.7)]) we have 



J2p''Qniy)Qnix) = Y[ — 



(1-pV) 



(1 + p2g2/c _ 2pg'= cos(0, + 9y))il + p^q^'' ~ 2pgfe cos(^, - By)) 

Since the last expression is a product of positive factors, this ends the proof when |g| < 1. 
□ 
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Let (Xn) be a Markov chain with initial distribution ^ and the transition probabihty 

oc 

P,{dy) - ^p"Q„(y)Q„(x)M(d2/). 



n=0 



Lemma 8.2 (X„) is stationary, and satisfies condition 



Proof. Applying Fubini's theorem to the function which by Lemma S.l is non-negative we get J Px{A)^{dx) 
jA^R'^'^=oP"'Q^(y)'^n{x)^i{dx)^{dy). Since / Qn{x)n{dx) for aU n > and Qq = 1, we get 
J Px{A)iJL{dx) = fJ,{A). This proves stationarity. 

To prove ([^), by the Markov property it suffices to show that E{Xi\Xo, X2) ~ j^^{Xq + X2). Let 
<j>{Xo, X2) > be an arbitrary bounded measurable function. We will verify that 

EiX,(f>{Xo,X2)) = -^E{{Xo + X2)<P{Xo,X2)). (31) 
1 + p"^ 

Since 4> is square integrable, and Qn,m,{x, y) — Qn{x)Qm{y) are orthogonal in L2{fJ,{dx)^{dy)) we can 
write 4){Xq,X2) = (j)o{XQ, X2) + '}2Ti=o4'i,jQi{^o)Qj{.^2), where (ji^ is orthogonal to all polynomials in 
variables Xq,X2- In the case R < 2 we have (j)o = because (Qn) are an orthogonal basis of L2{n)- 

Notice that the joint distribution of Xq, Xi, X2 is given by 

00 

v{dx,dy,dz) ^ ^ p'^^^Qn{x)Qn{y)Qk[y)Qk{z)^J.[dx)^l[dy)^x{dz). (32) 

n,fc=0 



From ( 30 ) and orthogonality we get 

vQn{y)Qn~l{y)^J.{dy) = 6„ 



Moreover, / yQn{y)Qk{y)fJ'{dy) = for fc 7^ n ± 1. 
Therefore 

j y4>{x,z)u[dx,dy,dz) ^^p"-+^<l)n,k J yQn{y)Qk{y)fJ'{dy) 

n.k 

Similar calculation gives 

/oo 00 
X(t){x, z)iy{dx, dy, dz) = ^ p^"6„+i</)„,„+i + ^ p^"6„+i0„+i,n- 

n=0 n=0 

Since by symmetry a similar formula holds true for the integral of z instead of x, we get 

/oo 
{x + z)4>{x,z)v{dx,dy,dz) = (1 + p^) ^ P^"6„+i(0„,„+i + 4>n+l,n)- 

n=0 

Comparing the coefficients in the expansions we verify that 

y0(x, z)v(dx, dy, dz) = — + z)(f>(x, z)i'(dx, dy, dz), , 
^ + P'' J 



proving (|3 
□ 



Lemma 8.3 (Xn) satisfies condition with the coefficients in determined by the equations 
and D^O. 
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Proof. By the Mar kov property it suffices to show that E{Xf\Xo, X2) — Q{Xo, X2)- To this end, as in 
the proof of Lemma 8.2, we fix a bounded measurable function (f>(XQ,X2) — fe '^n,fc'3n(^o)Qfc(^2)- 
We will verify that 

E{Xfcb{Xo,X2)) = E {{A{Xl + Xl + BX0X2 + C)) 0(Xo, X^)) (33) 

by comparing the coefficients in the orthogonal expansions. 

From (|o|) we get J y'^Ql{y)n{dy) = bl^^ + bl, and J y^Qn{y)Qn+2{y)fJ.{dy) = 6„+i&„+2. Moreover, 
by orthogonahty / y^Q,i{y)Qn+k{y)tJ-{dy) = except when k = 0,2,-2. Using these identities and the 
expansion / y'^(j>{x, z)iy{dx,dy,dz) = Y.n,k P^^^'t'n^k J y'^Qn{y)Qn+k{y)lJ-{dy) we see that 

/ y'^(l){x, z)v{dx,dy,dz) = (34) 

E5r=0 P^"<^n,«(&^+1 + bl) + p2 Y,'^^^ P^"&„+lfo„+2((/'n,n+2 + <t>n+2,n)- 

We now turn to the right hand side of (|33|). Since 

/oc 
(/)(a;, z) p'^^x^Qn{x)Qn{z)^i{dx)^{dz), 

n=0 



a calculation based on ( |30[ ) yields 

j x'^4>{x,z)v{dx,dy,dz) — (35) 

Er=0 P^"'/'n,«(6^+i + + Er=0 P^"'/'n,n+2fon+l6n+2 + p'' ^^=0 P^"'/'«+2.nfo«+l&n+2- 

By symmetry, 

J{x'^ + z^)(j){x, z)v{dx,dy,dz) = (36) 

2 Er=0 (^n+l + + (1 + P')Er=0/''"('^",«+2 + '/'n+2,„)6„+l?>„+2. 

Another elementary calculation using (^^ gives 

j xz(j){x, z)v{dx,dy,dz) — (37) 



P 

=Q P'^"'{4>n,n+2 + 4>n+2.,n)bn+lbn+2- 

Since / (f>{x, z)i'{dx, dy, dz) — E^^o Z'^"*'^"."' '^'-'^ verify that (33) holds true by verifying the 

relation 



y'^4>{x,z)v{dx,dy,dz) = J (^A(x'^ + z^) + Bxz + (j){x, z)i>{dx, dy, dz). 

Comparing the coefficients in the expansions, the latter reduces to the following. 

• Coefficients at 0o,o match when 

{2A + Bp^)bl + C ^bl 

(this holds true by @) 

• Coefficients at 4'n,n for n > 1 match when 

2A{bl+, + bl) + + + C = bl+, + bl 

(this holds true after a longer calculation using b'^j^^ = qb"^ + 1, (||), and (^) 

• Coefficients at 4'n,n+2 and at <j)n+2,n for n > match when 

^(1 + p4) + Bp^ = p2 

(this holds true by (H)) 
This implies that (|3^ ) holds true, q 
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9 Concluding Remarks 

1. To simplify the notation, we restricts ourselves to one-dimensional distributions of the random fields 
on Z. In principle our technique is directly applicable to all finite-dimensional distributions, and to 
multivariate- valued random fields on Z, sec H. 



2. Symmetric distributions in Theorem 3.2 differ from the distributions corresponding to quadratic 
conditional variances in llql . 



3. The density in Theorem 3.2 (i) has explicit product representation which can be recovered by a 
change of variable from the density identified as the "weight function" for the continuous g-Hermite 
polynomials, see 0, Section 3.29] and |, (2.14)]. 

An interesting exphcit case arises when Q{x,y) = (x^ + 2/^) + ^ j^p^ xy + ^^~\]l^p'r^ ^ ■ In 
this case q = and thus Qn{x /2)/2 are the Chebyshev polynomials of the second kind. This implies 
that |Xo| < 2 has the density - x'^. 

4. It would be interesting to know whether there are stationary processes which satisfy conditions (|^), 
with coefficients in (||) corresponding to i? > 2. (Formula ||, (3.13)] with q' — 1/q <1 indicates 



that the conclusion of Lemma 8.1 fails.) 
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Note Added Late 

Matysiak ||ll| pointed out to us that assumption (^) can be weakened to 1 + r2 — > 0; the latter 
condition is just the linear independence of Xq, Xi, X2. 
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